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Llntrodaction FIELD OF THE INVENTION 

The present invention relates to methods for establishing emotions, sudi as contentment, joy, dissatis- 
faction, grief, liking, love, dislike, hate, revenge, depression, sadness, fear, envy, jealousy^ shame and feeling guilt, 
in robots, agent systems and entertaimneiit software. The emotional importance of objects and shuations for a 
robot or agent is described. 

DESCRIPTION OF THE RELATED ART 

Experts in robots and agent systems are concerned with implementation of emotions in robots/agents 
Computer scientist ore oonoomod with representation of emotions in e leotronio devices sinc e s ev e ral y e ars. 
because they: 

<bl) concluded that without emotions a robot/agent can be nather intelligent nor autonomous. e.g. M. Minski said 
that ..the question is not whether intelligent machines can have any emotions, but whether machines can be 
intelligent without any onotions** Cm The Society of the A^d: Shnon and Schuster New York. 1986\ and 
wanted establish emotions in a robot/agent in such a wav that it would handle intelligent and autonomous: 

(b) want ed tn mak e robots more userfiiendlv or to have emotional virtual persons in entertainment or advertising 
software: 

(c^ attempted to recognize and measure emotions of a man. 

Problem fa) is not solved until now, although there were attmipts to get motivated robots/agents: examples: 
ffl Agent in I know the following pi^x s re (potento) which ooncom the representation of emotions in d e ctr eiae 
devieesll : ]] Padgham & Taylor [PTA] (1997) [[ , ]] - it can be used only as a toy. Robots in (ii) T. Skibata & K. 
Ohkawa &K. Tanie ..Spontaneous Behavior of Robots for Cooperation ^ Emotionally Intelligent Robot System" 
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ICRA'96, Proceed TFF.R 1 996. and in (iii^ M. S. El-Nasr & M. Skubic -A Fuzzv Emotional Agent for Dedsjon- 
Makinff in a Mobile Robot" TREE, p. 135 - 140. 1 998. may be treated merely as a first step towards building an 
emotional agent. Motivated agent system in fiv^ A. Schurmann TASlI 1998. and f AS21- 1998. mav be used in 
not complex situations where not complex activities are needed. 

A key problem in developing intelligent and autonomous robots/agents is to judge how good or bad is a 
recognized object or situation for the robot/agent- at present. An attempt to solve this problem is to assodate a 
vector of attributes^ such as hope, fiiistration. love, hate, iov. despair, fean these attributes are weighted when 
calculating how good or bad is the object for the robot/agent. This is a rough judgement method > the used 
emotions are too general and the current intenaties of deares and needs of the robot/agent are not taken into 
account. Such judgement of objects and situations is not intelligent enough in manv cases. Therefore, also the 
behavior of a robot/agent based on such object judgement is not intelligent in many situations, e.g. when a robot 
needs energy supply and an urgent situation appeared. 

The judgement method given in H-Nasr & at all. (iiiV is e ven less satisfkctory than the method mentioned 
above. The robot described there has onlv emotions anger, p ain and fear. To an recognized event or object is 
associated a desirability attribute measuring how desirable is this event or object with regard to goals. Using this 
dearabilitv and the priorities associ ated to goals, the priority of emotion with regard to a goal is calculated: then. 
using a rather large number of emoti<Mial rules, the activitv to b e executed is nhr>y>n iw^i .c e of assodating a 
desirabilitv attribute wit h regard to goals, this method of object judgement is a very rough one and has verv 
restricted gqjplicadon. 

In mv said in (iv) papers, an agent systan has desires with respect to needs of the agent: the above 
motioned basic emotions (hope, finstration. love, etc.^ are not consad^ed. In these papers, to object and 
atuations are associat ed desire attributes vMi regard to the needs of the agent: sudi desire attribute shovys how 
the object or situation increase or decrease a desire inten^ty with regard to a need. These desire attributes enable 
acceptable judgement of recognized object and atuationsu if we acc^t that the agent has rather restricted 
intelligence and autonomy. Mv papers in (M do not solve the problCTi f al if we want an intellig«it and 
autonomous robot/agent. 

Problem (b) was investigated in: (v^ Mizokawa & T. Iwata^Shi & Shizuoka-ken ..Control system and 
method for controlling object using emotions and personality generated in the object". Eur. Pat EP 0978790A1. 
Fdir., 09 2000. (yiS Breese & Ball [BRD] (1999), (yg) Brush & at all [BDL] (1998), (vm) Clynes [CLY] (1996), 
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fix) Kawamoto & Omura [KAO] (1994), £x) Knight & at aU [KMS] (1997), {33} SkeUy [SKE] (2000), (3^ Tow 
[TOW] (2000) . (xiii) K Lee ^tegration of Various Emotion Eliciting Factors for Life-like Agents". ACM p. 
155- 158. 1999- and fxiv> R. Nakatsu St J. Nicholson & N. Tosa Jmotion Recognition and Its Application to 
Computer Agents with Spontaneous Interactive Capabilities", KBA^'99, Workshop on Emotion-Based Agent 
Architectures. Seattle USA. May 1999 . These papers/patents do not conader the problem (a^. 

Problem f c) is not solved in a satisfactory wav - no published method recognizes or measures emotions 
rdiable on basis of facial expression- voice prosody or motion hehiivtor , e.g. die methods given in (v>, (vi> md 
(xiv). 

In all said oaoers/patents, except mv papCTS. are conadcred only the so called basic amotions f happiness. 
sadness, love. hate> fear, adcnovrfedgement expectation, aggres^veness. expectation! which can represent only 
general emotion states of a robot/agent or a virtual person. In my said papers these emotions are not con^dered: 
the motivation of a robot/agent to execute an activity is there detCTmined by means of desires with regard to 
needs of the robot/agait. I n these poper s L amotions oro modollcsd in oth e r way than briow and not s ufii agHtr 

1. BRIEF SUMMERY OF THE INVENTION 

In mv invCTtion. satisfactions and desires widi regard to needs of a robot/agent or a virtual person (denoted 
by Pd) are the primary emotions. The emotions contentm^t. iov. dissatisfac tion, anger, grief, sadness, liking- 
love, dislike, hate, retaliation and revaige. fiiistration, depression, envy, jealousy, shame and feeling guilt are 
secondary emotions: the intensities of these secondary emoti ons are obtained bv short procedures or rules from 
intensities of satisfactions and desires with regard to the needs of Pd. In this wav. the emotional states ofPd and 
the devdopment of emotions are described more precisely than in the methods given in the papCTs/patents 
ffl....,(xiv> mentioned in the above paragr^h. 

The established intensities of satisfaction and deare of Pd with regard to a need enable to connect a stimulus 
pattCTL with regard to that need- with object and atuation models. Such stimulus pattern with regard to a need 
describes the ^qjected alterations of satisfaction and desire intenaties with regard to said need, in a time pCTod, 
when /V/has recognized an object or a atuation as an instantiation of said object or situation model containing 
this stimulus pattern. By stimulus patterns, conn ected vyith an object or a situation, and current intensities of 
satisfactions and desires, the current stimulus intenaty cffi^iA nr ^ft^ir^ti pn is calculated. This stimulus 
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mtensitv measuresu satisfactory- how good or ba d is said object or situation for Pd at p rp>«^ ^^"^ 
patterns describe much more precisely how emotion intenMties diange. than said, in the above paragraph, vector 
of attributes (such as hopeL frustration- love, hat e. joy,...V the said stimulus intenatv of an object or satuation 
measures more intelligently the importance of this object or situation for Pd. at present: by stimulus intensity of a 
gtt^iarinti, ft rft" ^^^^ 9f tV^n {ginTfV^ns is more urgent at pr esent. Additionally- said stimulus pattern 
with regard to a need, enables to calculate the e?cpected int^isities of satisfaction and desire with regard to the 
need- at present and in the future, when /V/ has recognized an object or a situation. 

Due to said current stimulus intensity of a situation, an inteUigent motivation ofPd to execute an activity 
can be determine (however- sudi motivation is not conadered in this desmption^ and in this way solve the said 
prol)l^ (a), 

The representation of emotions given in thi s de s cription is bas e d on notions (desire s and fHttigfaction, stimuli) 
introduced in my papers [ASl] (199 R ) and [AS2] (199^). The representation of emotion s tat e s, given below, 
e nables very good mmulotion of emotions — a) In Internet and entertainment software one may represent virtoal 
people who b e hav e e motional, according to the changing surrounding, and und e r s tand emotions of other virtual 
people, e.g. a wtuol man in Internet who expresses emotions when he s hows ware. — b) In agent systems wteeh 
handle and oommunioat e with people. Suoh agent system oould not only express emotions aooording to actual 
Mtuations but also understand emotions of people in surroundings of the agent ^stom. These apptications oafr be 
made if al s o other probl e ms are solv e d, e .g. perception which con identi^ emotions, connoetion of behavior s with 
CTiotion s t^esr 

In paragraphs 3 7 below are given short procedures and rules which determine (and show the 

developme nt oft the intenaties of the following ^notions u^g said intaiaties of satisfactions and desires with 
r^ard to needs of Pd\ In this paper, the fbllowmg stimulus and emotion s tates ore formal d e scrfe edr 
th e stimuli of OSA, where OSA denote s an object, a situation or an activity; 

- contentmoit, joy, happiness, dissatisfaction, annoyance, anger, gri^ sadness, pain and suffering v^QuS^rsLtoa 
nsedjQfJ^; 

- positive emotions fedki^ (liking, afifection, love) and negative emotions foclings (dislike^ axiger) to/for gn 

object, a ^tuation or an activity [[ OSA ]] ; 
' contentment satisfactio n- and joy when a [[goal ( ]] goal situation [[ ) ]] is achieved; dissatisfaction, anger and 

disappointment when a goal situation is not achieved; 
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- retaliation and revenge on an object, hate to an object; 

- frustration, depression [[ , ]] and sadness [[ , ]] with regard to a pmon, an object or a goal: 
-envy [[ , ^ at a success or a proper tv of a person or an oth er robot/agent: 

::. jealousy [[ , ]] anil shame ; and 

■ feeling guUt with regard to a living object a robot/agent or a group of persons or robot/agents, when has 
made damage to them or violated some norms or rules . 
The intenaties of some of these emotions. detCTmined according to my invention, can be used to control and 

to measure the efiBdency of the robot/agent Pd as follows: 

- The intenaty of contentment joy, happinessu dissatisfaction. annoyanccL anger, grief sadness, pain and suflfering 

with regard to a need, of Pd measures how good or bad Pd has realized the need b/\£b denotes the need 
achieve goal situation Shdst^^ then this intenatv measures how good or bad Pd has realized the adiieving of 
the goal SMz'^ 

- The intensitv of positive emotion (or negative emotion^ towards an object or a atuation measures how usefiil 

for how great obstacle. respectiveM has bee n this object or situation for Pdi 
-The intensity of frustration with regard to a need shows how bad Pd has been able to realize this need: 
-The intensity of fear measures the un-ability of Pd to cope with a situation or to achieve its goal, when executing 

an activity; 

The intaisity of ^lame measures how strong P</ has violated some norms or rules. 

The invention is also a good solution of the, said in the paragraph above, problem (b), because it enables 

- to get more exactly the emotional persp nglit y of an agent or virtual person, than the other existing methods, and 

- to show how emotions of a virtual person/agent develop. 

Because the invention difiers from other existing methods for establishing emotions in a robot/agent the 
following description is very detailed and contains many examples. The function notation, e,g. bef(Pd,bj), 
zfulfPdbM. abhas(PdOSJ) etc.. is used onlv because of its good legibilitv. I could use also the notation befM u * . 
zfulM K , ■ abhasM nfn etc. to represent emotion intensities, however this notation is not easilv legible. 



DETAILED DESCRIPTTON OF THK INVENTION 



2. Representation of Desires and Patterns of Stimuli 



